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(54) A method and apparatus for a virtual display/keyboard for a PDA 

(57) An improved computer or PDA (1 00) with a pro- 
jected display onto a substantially flat, white surface 
(102, 200) to create a virtual computer screen display 
(104) and a projected keyboard (108) onto the substan- 
tially flat, white surface (102, 200) and a laser sensor 
(202) projected over the keyboard and parallel to the 
substantially flat, white surface (102, 200) to create a 
virtual keyboard (108). The virtual display (104) and vir- 
tual keyboard (108) permit the computer or PDA (100) 
to be substantially smaller than typical computers or 
PDA's, while also permitting a relatively normal size dis- 
play and keyboard/user input area. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates generally to the 
field of personal digital assistants (PDA's) and more 
particularly to keyboards for PDA's. In particular, this 
invention provides a space saving virtual display/key- 
board for a PDA. 

BACKGROUND OF THE INVENTION 

[0002] Personal digital assistants (PDA's), such as the 
Apple Newton or the Palm PILOT, have become very 
useful devices for carrying personal notes, calendars, 
appointments, phone numbers, 'to do' lists, etc. PDA's 
are hand held personal computers that help to manage 
personal information. It would be desirable for PDA's to 
be as small as possible, such as the size of a credit 
card, so that they could be carried in a wallet, purse, 
pocket, brief case, etc. Two of the main limiting factors 
to the size of PDA's is the requirement for a reasonable 
quality display and some means for user input, such as 
a keyboard or area for pen input To date there has been 
a tremendous tug-of-war between the desirable small 
size for portability and the larger size necessary for user 
input. Accordingly, it would be desirable for a PDA to be 
relatively small for portability, yet also have a reasonably 
sized display and user input area. 

SUMMARY OF THE INVENTION 

[0003] The above and other aspects of the present 
invention are accomplished in a personal digital assist- 
ant (PDA) having a virtual display/keyboard. In the PDA 
according to the present invention, the PDA uses a pro- 
jection display to create a virtual screen and a projec- 
tion 'linger sensor" to create a virtual keyboard on any 
flat, light colored surface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0004] The above and other objects, features and 
advantages of the present invention will be better under- 
stood by reading the following more particular descrip- 
tion of the invention, presented in conjunction with the 
following drawings, wherein: 

Figure 1 illustrates a top view of a virtual dis- 
play/keyboard for a PDA according to the present 
invention; 

Figure 2 illustrates a side view of a virtual dis- 
play/keyboard for a PDA according to the present 
invention; and 

Figure 3 illustrates a top view of a virtual dis- 
play/keyboard for a PDA having projection lasers 



and sensors for determining finger stroke position- 
ing according to the present invention. 
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[0005] Figure 1 shows a top view of a PDA 100 pro- 
jecting a virtual display 104 and a virtual keyboard 108 
onto a flat, light colored surface 102. The projection sur- 
face 102 would preferably be a substantially white sur- 
face, such as a sheet of paper. Also, the virtual keys on 
the virtual keyboard 108 need not be, but may prefera- 
bly be in a staggered pattern to allow for laser sensor 
pick-up, as shown in Figure 2. The projection 106 may 
be accomplished by means of one of several projection 
technologies. One example would be the Texas Instru- 
ments Digital Micro mirror Display (DMD). 
[0006] Figure 2 shows a side view of PDA 100 with 
projection 1 06 being emitted from a top edge 208 of the 
PDA card 100 onto a substantially flat, light colored sur- 
face 200, such as a white sheet of paper. Finger sens- 
ing of virtual keyboard keys 108 is accomplished by 
means of laser beams 202 emitted from a bottom edge 
204 of PDA card 100 just above the surface of the flat, 
light colored surface 200. Accordingly, each laser 302 
and 306 would sense when a finger or pen 300 had bro- 
ken the laser beam 202 by sensing the reflection from 
the finger 300 of the returned laser light to a sensor 
device 304 and 308, such as a CCD array, see Figure 3. 
Measuring the laser angle a and p for each of two lasers 
302 and 306 to the finger 300 would identify the exact 
key location 108. This allows the PDA 100 to sense that 
the user had "touched" a key 108, either as a keystroke 
or a pointing action. 

[0007] In operation, any data that would normally be 
displayed on a notebook screen or computer CRT will 
be projected onto the flat, light colored surface 200 by 
means of, for example a Digital Micro mirror Display. 
Also, virtual keys of a keyboard 108 will be projected on 
to the light colored surface 200 in a staggered fashion, 
such that when the user touched or points to a particular 
key, laser sensors 204 at the bottom edge of the PDA 
card 100 will detect which key is being indicated and the 
PDA 100 will accept the input as if a key on an actual 
keyboard had been depressed. Also, as the application 
of the PDA changes from, for example, a calendar to an 
address book or to a personal notebook, the functions 
of the various keys on the virtual keyboard may change 
to correspond to the associated application of the PDA 
100. It should also be noted that the PDA projects a vir- 
tual display screen 104 and virtual keyboard 108 that is 
substantially larger than the area of the PDA. This is 
how the dual goals of a small PDA size for portability 
and a large display/user input area is accomplished - by 
projecting a much larger display/keyboard from a small 
PDA card. 

[0008] The foregoing description of the present inven- 
tion has been presented for purposes of illustration and 
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description. It is not intended to be exhaustive or to limit 
the invention to the precise form disclosed, and other 
modifications and variations may be possible in light of 
the above teachings. For example, the present invention 
may also be utilized in personal notebooks, personal $ 
computers, recreational computer games or in any sim- 
ilar situation where there is a need to conserve the 
space typically utilized for the computer display and 
user input/keyboard for the purposes of portability or 
changing desk top configurations, etc. The embodiment 70 
was chosen and described in order to best explain the 
principles of the invention and its practical application to 
thereby enable others skilled in the art to best utilize the 
invention in various embodiments and various modifica- 
tions as are suited to the particular use contemplated. It 75 
is intended that the appended claims be construed to 
include other alternative embodiments of the invention 
except insofar as limited by the prior art. 

Claims 20 

1. A method for creating a virtual display (104) and 
keyboard (108) for a computer comprising the fol- 
lowing steps: 

25 

(a) said computer projecting a virtual display 
(104) of data representative of a computer dis- 
play onto a substantially flat, light colored sur- 
face (102 t 200); 

30 

(b) said computer projecting a virtual keyboard 
pattern of keys (108) onto said substantially 
flat, light colored surface (102, 200); and 

(c) said computer embodying remote sensing 35 
means (304, 308) for determining which virtual 
keys are selected. 

2. The method according to claim 1, wherein said 
sensing means (304, 308) for determining which 40 
virtual keys are selected comprises the following 
steps: 

(1)said computer projecting a laser sensor 
(202) slightly above and substantially parallel to 45 
said substantially flat, light colored surface 
(102, 200); 



3. The method according to claim 1, wherein said 
computer is a PDA (100). 

4. The method according to claim 2, wherein said sub- 
stantially flat, light colored surface (102, 200) is 
white. 

5. The method according to claim 2, wherein said sub- 
stantially flat, light colored surface is a substantially 
white piece of paper (102, 200). 

6. The method according to claim 2, wherein the pro- 
jecting steps are accomplished by means of a dig- 
ital micro mirror display (106). A 

7. A display/keyboard of a computer comprising: 

a virtual display (104) projected from said com- 
puter by means of a digital micro mirror display 
(106) onto a substantially flat light colored sur- 
face (102, 200); 

a virtual keyboard (108) projected from said 
computer by means of a digital micro mirror 
display (106) onto said substantially flat, light 
colored surface (102, 200): and 

two laser sensors (302, 306) projected across 
said virtual keyboard and substantially parallel 
to said substantially flat, light colored surface, 
wherein when said laser sensors (302, 306) 
are intercepted over a virtual key of said virtual 
keyboard (108), said computer processes data 
as if a physical key on a physical keyboard had 
been selected. 

8. The display/keyboard according to claim 6, wherein 
said computer is a PDA (100). 



(2) said laser sensor (202) being projected 
across said virtual keyboard pattern of keys so 
(108) such that when said laser sensor (202) is 
intercepted by a finger or other object (300) 
said computer processes input as if a physical 
key on a physical keyboard had been selected; 
and 55 

(3) sensing when a virtual key has been 
selected. 
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